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Shop code 


Shop name 


File name of in-store layout information 


0001 


Supermerket AA 


SupermarketAA.JPEG 


0002 


ABB 


ABB.JPEG 
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Receipt number 


Member ID 


Delivery date/time 


Collection method 


Collection flag 


0001 


AAOOOOl 


00/11/14/18/00 


Cash 


ON 


0002 


AAOOOOl 


00/11/14/18/00 


Cash 


ON 


0003 


ALOOOOl 




Cash 


OFF 


0004 


DD00003 


00/11/14/20/00 


Credit card 


ON 
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User terminal 



SI 



Intermediation server 



Access intermediation server 



Receive request for 
DD&PW and display screen 
for inputting ID&PW 




S3 



Send request for ID&PW 



\f 



Send ID&PW 



S7 



S13 



Receive ID&PW 
and authenticate 



Display screen for selecting menu 
or commodity order 




S9 



Send display info for 
selecting menu or 
commodity order 



Sll 



S15 
Yes 



Send menu 
selection info 



Receive menu 
selection info 



Display screen for cooking 
menu 



S23 



819 



S21 



Send display info for 
cooking menu 



Send cooking selection info 



S25 



S31 



S27 



Receive cooking 
selection info 



Display screen for recipe 



S29 



Send display info for recipe 



S33 



Send selection info for 
commodities 



S37 



S35 



Receive and store selection 
info for commodities 



Send commodity 
order selection info 



S41 



Display screen for selecting 
purchase request conmiodities 
and shop 



Refer to shop/commodity info 
table, and generate and send 

display info for selecting 
purchase request commodities 
and shop 



© 



S45 



Send shop and commodity 
selection info 




S39 



S47 



Receive shop and 
commodity selection info 



Fig.7 



Welcome to Order System!! 
What is your today's menu or your order of commodities? 



I Please click this button if you will 
order commodities, 

iPlease click one of these buttons if 
you'd like to see menus. 



Commodity order 
processing 




800 



Cooking Recipe 




814 



812 



Chinese food 




816 



Fig.8 



r 



^Western fo^ What is your today's menu? 



^Boil ^ 



Pish 


Meat 


Vegetables and others 


^ Sahnon 

meunierer 
■ ■ ■'■ ■ ■ 


A 

CD 

T 


Steak 


▲ 
▼ 






) Alfonsino boiled 
in sugar 
■■■■■■ 


A 
▼ 




▲ 
▼ 




▲ 
▼ 




▲ 








▲ 




W 




T 








▲ 




▲ 




A 

a 








T 


1 


t 




Fig.9 



.1000 




Salmon meuniere - Milanese st^e 



.1002 



Material for 5 persons 




|H| Slices of salmon 


5 pieces 


n Salt and pepper 


a little 


[B1 Olive oil 


appropriately 


B Tomato 


large one 


□ — -- 




□ -— 





How to cook 

1 . • • 

2. • . 

3. • • 



Transmit 



1004 



1006 



r 



Fig. 10 



Welcome to order delivery system! 
Thank you very much for your constant patronage 



Yoxir request commodity 



,1102 



Commodity names selected 
on the menu 

Your request shop 




1106 



C Flesh fish, cheap price 
OO shop 

^ Tbday harvest festival sale! 

Vegetable at a special price! 
\^XX store 




1100 



1104 



You can get an3rthing you want! 
Sup ermar ket A A 



1108 



Fig. 11 



Welcome to order delivery system! 

Thank you very much for your constant patronage. 




Your request commodit; 
Commodity names sele< 
on the menu 

Your request shop 



Flesh fish, cheap \ 
OO shop 



Vegetable 
Meat 

Dairy products 
Miscellaneous goods 



^ TDday harvest festival sale! 

Vegetable at a special price! 
\^XX store 



1106 



t anything you want! 



V letAA 



1100 



Fig 12 



Welcome to order delivery system! 

Thank you very much for your constant patronage. 



Your request commodity 



Pish 



Commodity names selected 
on the menu 

Your request shop 



Flesh fish, cheap price 
OO shop 

TDday harvest festival 
Vegetable at a special 
XX store 



,1102 





1106 
1106A 



i3i;hing you want! 



Fig. 13 



User terminal 

0 



Display screen for 
showing association 
figure between selected 
commodities and in-store 
layout 



Display screen 
including in-store 
layout and image 

while moving 



S67 



Intermediation server 



® 



Shop system 
(shop server and robot) 



S49 



Log in selected shop 




S51 



Send display info for 
showing association 
figure between selected 
conunodities and in- 
store layout 




Receive ID&PW. 
and authenticate 



Optimize route to move 

around comers of 
selected commodities 



S56 



Send instmction regarding 
moving route 




S63 



S59 



Receive instruction 
regarding moving route, 
and start moving 



Receive images 
while moving 



S61 



Continuously send 
images while moving 



Continuously send 
display info including 

in-store layout and 
image while moving 



S65 
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Fig. 14 
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User terminal 



Intermediation server 



Shop server 
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Accept and send selection 

of function button on 
screen including in-store 
layout and image while 
moving 



S85 



Display screen including 
in-store layout and image 
while moving 



S87 



No 



Commodity 
selection screen button^ 
selected? 

Yes 



S89 



Send selection info of 
conmiodity selection 
screen button 



Receive selection info 
of function button 



S71 



S73 



Send execution 
command for selected 
function 



S75 



Receive execution 

command for 
selected function 



Receive images 
while moving 



S81 



S77 



Execute command 



Continuously send 
images while moving 



S79 



S83 



Continuously send 
display info including 

in-store layout and 
image while moving 



Receive selection 
info of commodity 
selection screen 
button 



S91 




Fig. 18 



User terminal 



Intermediation server 



S95 



Receive info representing 
arrival and individual 
article image 



Display evaluation and 
order screen including 
commodity info and 
individual article image 



S99 




Shop system S93 
nJ 



Reach comer of selected 
commodity, and automatically 
select individual article, and 
send info representing arrival 
and individual article image 



Refer to shop/ 
commodity info table, 
and send display info 

including 
commodity info and 
individual article image 



SlOl 



Yes 



Send 
evaluation 
operation 

info 




S97 



S105 



Receive evaluation 
operation info 

T 



i>end operation 
command info based 
on evaluation 
operation info 



S107 



r-J 



S117 



Voice conversation 
processing 



S109 



Receive operation 
command info based 
on evaluation 
operation info 



S115 



Voice information 
transfer processing 



S125 



Display evaluation 
image 




Voice conversation 
processing 



S123 



Perform operation 
conmiand 



S119 



Triansfer evaluation 
image 



S121 



Continuously send 
evaluation image 
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User terminal 
G 



Intermediation server 



Send 
order info 




Shop system 



S129 



Receive order 
info 



S131 



S165 



Send 
selection 
of next 
screen 



S167 



Store order info 
into order delivery 
info table 



S133 



Receive 
selection of 
next screen 



Send command 
to bring 
individual 
article into cart 



S135 



Receive 
command to 
bring individual 
artic le into cart 

1 



S137 



Execute 
command 



S145 



S139 
S141 



Receive completion 
notice including 
individual article 
identifier 



Acquire individual 
article identifier 



Send completion 
notice including 
individual article 
identifier 



Store individual article 
identifier into order 
delivery info table 



S163 



S147 



Send command to 
move to next 
conmiodity 



S149 



Display screen 
including in-store 
layout and image 

while moving 



S155 



S143 



Send display info 
including in-store 
layout and image while 
moving 



Receive conunand 
to move to next 
conmiodity and 
start moving 



S151 
1^ 



S153 



Continuously 
send images 
while moving 
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User terminal 



Intermediation server 



S165 



Send request for screen for 
inputting delivery request 
conditions 



S171 



Display screen for inputting 
delivery request conditions 



S173 



Accept inputs of delivery request 
conditions and send delivery 
request conditions 



Receive request for screen for 
inputting delivery request 
conditions 



S167 



S169 



Send display info for screen for 
inputting delivery request 
conditions 



Receive de! 
cone 


ivery request 
litions 




/ 


Store delivery request conditions 



S175 



S177 
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User terminal 



Intermediation server 




Shop system 



S179 



Send logoff 
request 



Receive logoff 
request 



S181 



No 



S187 



Display 
confirmation 
screen 



S189 



Transmit 
confirmation input 




Read out order info and 
delivery request condition 
info from order delivery info 
table, and generate and send 
display info for confirmation 



screen 



S185 



Receive confirmation 
input 



S191 




S195 



Send command for 
moving to cart 
transfer position 



S197 



S203 



Receive transfer 
completion 



Receive command for 
moving to cart transfer 
position 



S199 



Execute moving 
command 



S201 



Send transfer 
completion 



Send command for moving 

to predetermined initial 
position 



S205 



S207 



Receive command for 
moving to predetermined 
initial position 



Delivery instruction 
processing and price 
collection processing 



S211 



S209 



Execute moving 
command 
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